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Abstract. To our knowledge, the populations are generally assumed to be 
homogeneous in the traditional approach to evolutionary game dynamics. Here, 
we focus on the inhomogeneous populations. A simple model which can describe 
the inhomogeneity of the populations and a microscopic process which is similar 
to Moran Process are presented. By studying the replicator dynamics, it is shown 
that this model also keeps the fixed points unchanged and can affect the speed of 
converging to the equilibrium state. The fixation probability and the fixation time of 
this model are computed and discussed. In the inhomogeneous populations, there 
are different situations that characterize the time scale of evolution; and in each 
situation, there exists an optimum solution for the time to the equilibrium points, 
respectively. Moreover, these results on the speed of evolution are valid for infinite 
and finite populations. 
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1. Introduction 

Evolutionary game theory has been successfully founded and applied to the study of 
biology, economics, and social sciences by Maynard Smith pQ. Originally, evolutionary 
game theory was formulated in terms of infinite populations and the corresponding 
replicator dynamics. Consider two strategies A and B in a population engaged in a 
game with payoff matrix 

A B 
A a b. 
Bed 

A typical assumption is that individuals meet each other at random in infinitely large, 
well-mixed populations. The fitness (or payoff) of A and B players are respectively given 
by 

f A = ax + 6(1 - x), . . 

/b = cx + d(l — x), 

where x is the frequency of A players and 1 — x is the frequency of B players. The 
average fitness of the population is 

f = xf A + (l-x)f B . (2) 

The standard replicator equation which describes evolutionary dynamics in a infinite 
population takes the form [21 [3] 

x = x(f A - /) 

= x(l — x)[(a — b — c + d)x — (d — b)]. (3) 

The equilibrium points are either on the boundary or in the interior. There are four 
generic outcomes [U El [6]: 

(1) If a > c and b > d then A dominates B; the only stable equilibrium is x = 1. 

(2) If a < c and b < d then B dominates A; the only stable equilibrium is x = 0. 

(3) If a > c and b < d then A and B are bi-stable; both x = and x = 1 are stable 
equilibria; there is an unstable equilibrium at x = (d — b)/(a — b — c + d). 

(4) If a < c and b > d then A and B co-exist; both x = and x = 1 are unstable 
equilibria; the only stable equilibrium is given by x = (d — b)/(a — b — c + d). 

The standard replicator dynamics hold in the limit of infinite population size. In 
fact, any real population has finite size and also computer simulations in structured or 
unstructured populations always deal with finite populations El El [TDJ . Therefore, it is 
natural to study evolutionary game dynamics in finite populations. In most approaches 
for finite population size, each individual interacts with each other individual in the well- 
mixed, homogeneous populations. Moreover, stochastic processes have been introduced 
to study evolutionary dynamics in finite populations. Recently, in unstructured 
finite populations different mechanisms are applied to study game dynamics, such as 
Moran Process, Pairwise Comparison Process, Wright-Fisher Process, local information, 
mutation, discounting and active linking [HI [TJl [131, HU ESI [161 Q2] . 



Evolutionary game dynamics in inhomogeneous populations 



3 



To our best knowledge, in the aforementioned approaches to evolutionary game 
theory, they are all based on the simplifying assumptions that the populations are 
homogeneous and each individual, which is engaged in symmetric game, is identical to 
strategy update. In fact, biological agents in many real populations are non-identical 
to their abilities to competition, survival and reproduction. For instance, the difference 
in sex, male or female, plays a significant role in group dominance. The age, old or 
young; the strength, strong or weak, etc, are also factors affecting the individuals' 
competition and cooperation. Thus, we here relax the simplifying assumptions and 
consider that the populations are inhomogeneous. In our scenario, we aim to investigate 
the inhomogeneity's effect in evolutionary game dynamics. The remainder of this paper 
is organized as follows: A simple model is constructed to describe the inhomogeneity of 
the populations and a stochastic process for evolutionary game theory is introduced in 
section [2j And then analytical results and corresponding simulations of the model are 
provided in section [3j Finally, conclusions are made in section HI 



2. The Model 



In this model, the populations are well-mixed and each player interacts with each other 
player. To describe the inhomogeneity of the populations, we just assume that two 
types of players are distributed randomly in the populations (just like male and female 
individuals in a population) [HI [19] . For simplicity, we use E to denote one type players 
and F to denote the other type players. Every player has only one type and their 
distribution is fixed later on. The concentration of players E and F are denoted by 
v(0 < v < 1) and 1 — v. All individuals just follow A or B strategies no matter what 
types they are. And when players E interact with other players, the payoff of players 
E will be strengthened no matter what strategies players E follow; while the payoff of 
players F will keep unchanged no matter what strategies players F follow when players 
F interact with other players. Now, suppose the population consists of iV players. The 
number of players using strategy A is given by i, the number of players using strategy 
B is given by iV — i. If every player interacts with every other player, the average payoff 
of A and B are respectively given from a mean-field theory 



nA = «"M»-*> [ vqi + (i-v)) 
nf = " + T-T" 1) Ni + (i-^)] ; 



where the parameter q\(qi > 1) characterizes the rates of increased payoff of players E. 
Therefore, the average payoff of the population at the state is given 

<IL>=[inf + (N-i)Hf]/N. (5) 

Then, the average fitness of strategies A and B are respectively given by [20] 

f A — 1 - w + wTl A 



f B — 1 — w + wU 



B 



(6) 



where w measures the intensity of selection. Strong selection means w = 1; weak 
selection means w<l. 
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We now describe the selection mechanism process as follows: In each time step, an 
individual is chosen with a probability proportional to its fitness; a second individual 
is selected randomly. Then the second individual switches to the first one's strategy. 
Moreover, if the second individual is a player E, it will weaken the probability to switch 
to the first one's strategy; otherwise, it will keep the probability to switch to the first 
one's strategy. And we write the probability that the number of A individuals increases 
from i to i + 1 as 

l-w + wTl A i N-i r /, m ,„s 

[vq 2 + (l-v)\, (7) 



1-w+w <n> N N 
where the parameter q 2 characterizes the strength of reduced switching activity if the 
second individual is occupied by an individual of type E. Since players E can strengthen 
their payoff, they are not sensitive to switch their strategies, therefore, we set q 2 < 1 . 
The probability that the number of A individuals decreases from % to i — 1 is 

m / \ 1 — w + wIl B i N — i r . 

r 'W= 1 - tt , + tt ,<n> -iv- — -ta + d-"))- W 

Consequently, the probability that the number of A individuals remains constant is 
T(i) = 1 — T + {i) — T~(i). Since T~(N) = and T + (0) = 0, this process has absorbing 
states at i = and i = N. For large populations, a Langevin equation can approximately 
describe this process [TI] 

x = a(x) + b(x)e, 
a(x) = T + (x) — T _ (x), 
b(x) = y/[T+(x)+T-(x)]/N, 

where x = is the fraction of A, a(x) is the drift term, b(x) is the diffusion term and 
e is uncorrelated Gaussian noise. For large N, b(x) vanishes with l/x/iV, this equation 
becomes 

x = x(l-x) — — —r / • \vq 2 + (1 - v)\ 

v ' 1-w + w < n(x) > 1 H v n 

= F(v) -x(x-l)[(b + c-a- d)x + (d - b)]/G(w, x, v), (9) 

F(v) = [vqx + (1 - v)[vq 2 + (1 - v)) 

= (qi - - l)v 2 + (qi + q 2 - 2)v + 1, 
1 — w 

G(v, x, w) = h [vq 1 + (1 - v)] ■ 

w 

[(a-b-c+ d)x 2 + (b + c- 2d)x + d]. 

([9]) is the replicator dynamics equation for this model. For v — 0, the replicator 
dynamics equation for the Moran Process in homogeneous populations is recovered. 
For < v < 1, inhomogeneity is introduced in the system as there are two types of 



where 
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Figure 1. Frequency of A as a function of time for different equations from an initial 
state with 20% A, given fixed values of qi = 2, q 2 = 0.4 and w = 0.4 for ((9]) and (fTUJl . 

players in populations. Subsequently, the replicator dynamics, the fixation probability 
and the fixation time of this model are to be investigated and discussed for different 
values of the parameters. 

3. Analytical Results and Corresponding Simulations 

For the Moran Process in homogeneous populations, 

x = x(x - l)[(b + c - a - d)x + (d - b)]/T{x, w), (10) 

where w) = + [(a — b — c + d)x 2 + (6 + c — 2d)x + d]. Comparing with ([3]) and 
( JTUl) . ([9]) also has the three same equilibria: x — 0, 1 and (d — b)/ (a — b — c + d) and keeps 
the fixed points unchanged. Moreover, there are apparently four same generic cases for 
the stable equilibrium points to (J3j) by studying ([91). To illustrate this, let us consider 
an example. Consider the payoff matrix 

A B 
A 0.3 0.5 . 
B 0.1 0.2 

The fitness of A is greater than the fitness of B in this example. Hence, we say 
that A dominates B. Figure [1] shows the evolution from a state with 20% A into the end 
state with all A. Since a = 0.3 > c = 0.1 and b = 0.5 > d = 0.2, figure [U confirms the 
theoretical predictions. 




Evolutionary game dynamics in inhomogeneous populations 



6 



In fact, the differences among the three dynamics equations amount to a dynamics 
rescaling of time. And F(v) and G(v, x, w) in (Q are factors influencing the time scale 
only. They would affect only the speed of evolution, but would not influence the long- 
run behavior. Then, we would like to show that how they affect the time scale for 
different values of the parameters. In this model for the fixed values of qi, q 2 and w, 
G(v, x, w) ~ — — is constant with weak selection, then only F(v) can influence the time 
scale for the variable v. Here, F(v ) has a maximum at v = v c for different v G [0 1], and 
F(v) = (qi — l)(q 2 — l)^ 2 + (<?i + <?2 — 2)t) + 1 < F(v c ), then there exists the optimum v c 
to converge fastest to the equilibrium state. Since (qi — l)(q 2 — 1) < (qi > l,q 2 < 1), 
there are three cases for different relationships between q% and q^- 



2 



(gi + q 2 - 2) 

%1-1)(?2-1)' 

(1) If q\ + q 2 < 2, then F(f ) has its maximum at v c = 0. 

(2) If 2 < qi + q 2 < 2qiq 2 , then F(v has its maximum at v c = 1. 

(3) If gi + q 2 > 2q\q 2l then -F(u) has its maximum at v, 



2-9i-g2 



2(gi-l)(ga-l)- 

Especially, the interesting relationship between qi and g2 fc> r gi > 1 and g2 < 1 is 
gi?2 = 1- in this case, then q 1 + q 2 > 2qiq 2 = 2 and there is only one outcome for v c : 

The four outcome predictions, which can respectively reflect the four relationships 
between g x and q 2 , are found from the replicator dynamics equation, thus they are 
justified for infinite or large finite populations. In other words, it can converge fastest 
to the equilibrium state when v — v c for infinite populations. However, in finite 
populations, if the mean time to fixation becomes very large, the model may be limited 
interest, therefore, discussion on the fixation time T v is an interesting topic. Here, 
whether the fixation time T v in finite populations has a minimum at v c respectively 
corresponding to the four situations in infinite populations is a more interesting topic. 
Indeed, the four outcome predictions for infinite populations are still valid for small 
finite populations. For finite populations, T v means that the time from an initial state 
xo to the equilibrium state and can be calculated by [T3l [21] 

T v = N [ t(x,x )dx, (11) 
Jo 

where 



. 2[S(1) - S(x )]S 2 (x) . f x 2a(y) , . , 



, 2[S(1) - S(x)]S(x) ,f x 2a(y) 1 , / 



and 



V(x)S(l)S(x ) ^7o V(y) 

1) - S(x)}S(x) f x 2a(y) 

6 2 (x)5(l) 6XP 7o V{y) 

or \ r r n^z) 

S{x)= / exp[- / ——dz\dy. 
Jo Jo \ z ) 
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Figure 3. The fixation time T v as a function of v for N = 1000, given different 
relationships between qi and q^- (a). q\ = 1.2 and qi = 0.6; in this case, v c — 0. (b). 
qi = 2 and g2 = 0.8; in this case, v c = 1. (c). qi = 8.5 and 52 = 0.25; in this case, 
v c = 0.6. (d). qi = 5 and 92 = 0.2; in this case, v c = 0.5 
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As this can be done numerically in general, the corresponding simulation results 
are shown below. Before computing the fixation time, let us first investigate the fixation 
probability for this model. The fixation probability <pk with k players using strategy A 
is given by [22J 

, i+EtJnir^ 



i + EE 1 nL 



T+W (12) 



3=1 lli=l T+(i) 

;| -|4 (1 - w)(N - 1) + w(v qi + l- v )[ci + d(N-i- 1)] 

+ tl C 1 - tw)(iV - 1) + tw(ugi + 1 - u) [a(i - 1) + b(N - i)} 

j — 1 i — 1 

-pr (1 - w)(iV - 1) + wjvqi + 1 — v)[ci + d(N — i — 1)] 
+ ~1 tl (! - «»)(JV - 1) + + 1 - u)[a(i - 1) + 6(iV - i)) 

Now let us take the Prisoner's Dilemma for example. In most papers, the Prisoner's 
Dilemma is determined by the payoff matrix 

C D 
C b-c -c. 
D b 

To assure that the fitness of C and D are always positive, the payoff matrix becomes 

CD CD 
C b-c -c C b 0. 

D b D b+c c 

In the following simulation results, the initial frequency of cooperators is 80%, and 
we set b = 3, c = 2 and w = 0.0001. In figure [21 we show the fixation probability of 
a Prisoner's Dilemma starting with 80% cooperators. Clearly, cooperators are always 
dominated by defectors. It shows that stronger rates q\ decrease the fixation probability 
of cooperators and the fixation probability of cooperators monotonically decreases when 
the value of the parameter v increases with a given fixed q\. These results can be 
understood in the following way. When the values of q\ or v increase, it results in 
that the temperature of selection is enhanced. For the Prisoner's Dilemma, the average 
payoff of cooperators is less than the average payoff of defectors. Therefore, the fixation 
probability of cooperators decreases for the Prisoner's Dilemma when the temperature 
of selection is increased |19j . Moreover, we have found that the fixation probability has 
nothing to do with the strength of switching activity qi from (fT2l) . In figure [3l we show 
the fixation time of a Prisoner's Dilemma starting with 80% cooperators for iV = 1000. 
The fixation time from (TTTj) for different situations are computed, respectively. In 
figure [3(a), q± + q<i = 1.8 < 2. In this case, T v has its minimum at v = 0. And we 
observe that v c = from figure [3|a). In figure [3](b), 2 < q x + q 2 = 2.8 < 3.2 = 2g x g 2 - In 
this case, T v has its minimum at v — 1. And we observe that v c = 1 from figure [3]^b) . 
In figure EJ^c), 2gig 2 = 4.25 < qi + q 2 = 8.75, In this case, T v has its minimum at 
v = 2x( - 8 2 5 l 8 1 ox(o 2 25-i) = 0-6- And we observe that v c = 0.6 from figure M^c). In 
figure E](d), 2 < qx + q 2 = 5.2 and qiq 2 = 1. In this case, T v has its minimum at 
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v = 0.5. And we observe that v c = 0.5 from figure E](d). These results for finite 
populations are totally in very good agreement with theoretical predictions for infinite 
populations and these figures confirm that the fixation time T v also has its minimum at 
v c . Moreover, these results for the fixation time in finite populations are still valid even 
if w does not satisfy the condition: w < 1. 

4. Conclusions 

To sum up, we have studied the evolutionary game dynamics in inhomogeneous 
populations. We have provided a model by description of a microscopic process which 
is similar to Moran Process. Comparing with standard replicator and Moran Process 
dynamics, it also keeps the fixed points unchanged. Nevertheless, this can affect the 
speed of converging to the equilibrium state. We have also calculated the fixation 
probability and the fixation time, and found that there exists an optimum solution to 
converge fastest to the stable equilibria. This result requires no limiting assumption on 
population size. As is known, how to decrease the mean time to the fixed state from 
an initial state is an important quantity [23]. From this perspective, our results on 
inhomogeneous populations may shed light on this issue. 
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